Military  Operations  Research  Society 


712CD 


73rd  MORSS  CD  Cover  Page 

UNCLASSIFIED  DISCLOSURE  FORM  CD  Presentation 


For  office  use  only  41205 


21-23  June  2005,  at  US  Military  Academy,  West  Point,  NY 

Please  complete  this  form  712CD  as  your  cover  page  to  your  electronic 
briefing  submission  to  the  MORSS  CD.  Do  not  fax  to  the  MORS  office. 


Author  Request  (To  be  completed  by  applicant)  -  The  following  author(s)  request  authority  to  disclose  the 
following  presentation  in  the  MORSS  Final  Report,  for  inclusion  on  the  MORSS  CD  and/or  posting  on  the 
MORS  web  site. 


Name  of  Principal  Author  and  all  other  author(s): 

2  Lt  Jennifer  R.  Plourde,  USAF 
Dr.  Jeffrey  P.  Kharoufeh 

Principal  Author’s  Organization  and  address: 

AFRL/HEPC  CBD 
2729  R  Street 
Bldg  837 

Wright  Patterson  AFB,  OH  45433-5707 


Phone:  937-255-4903 

Fax:  937-656-4664 

Email:  Jennifer.Plourde@wpafb.af.mil 


Original  title  on  712  A/B:  Time-Adaptive  Sampling  of  a  Chemical  Hazard  Area 
Revised  title: 


Presented  in  (input  and  Bold  one):  (WG  2,  CG _ ,  Special  Session _ ,  Poster,  Demo,  or  Tutorial): 

This  presentation  is  believed  to  be: 

UNCLASSIFIED  AND  APPROVED  FOR  PUBLIC  RELEASE 


Time-Adaptive  Sampling  of  a  Chemical  Hazard  Area 


Jennifer  R.  Plourde 

Human  Effectiveness  Counter  Proliferation  Branch 
C hem- Bio  Defense  Team 

Air  Force  Research  Laboratory  (AFRL/HEPC  CBD) 
Wright  Patterson  AFB,  OH  45433-5707 

and 

Jeffrey  P.  Kharoufeh 
Department  of  Operational  Sciences 
Graduate  School  of  Engineering  and  Management 
Air  Force  Institute  of  Technology 
Wright  Patterson  AFB,  OH  45433-7765 

73rd  MORS  Symposium,  21-23  June  2005 


Air  Force  Institute  of  Technology 


UNCLASSIFIED 


1 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

30  SEP  2005 

2.  REPORT  TYPE 

N/A 

3.  DATES  COVERED 

4.  TITLE  AND  SUBTITLE 

Time-Adaptive  Sampling  of  a  Chemical  Hazard  Area 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROIECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Human  E®ectiveness  Counter  Proliferation  Branch  Chem-Bio  Defense 
Team  Air  Force  Research  Laboratory  (AFRL/HEPC  CBD)  Wright 
Patterson  AFB,  OH  45433-5707 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

1 1 .  SPONSOR/MONITOR' S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release,  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

See  also  ADM201946,  Military  Operations  Research  Society  Symposium  (73rd)  Held  in  West  Point,  NY  on 
21-23  June  2005. 

14.  ABSTRACT 

15.  SUBIECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

uu 

18.  NUMBER 
OF  PAGES 

64 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Overview 


•  Background 

•  Problem  statement  and  assumptions 


•  Methodology 

•  Illustrations 


•  Conclusions 


•  Future  Work 
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Background 


•  Chemical  and  biological  WMDs  are  a  current  threat  to 
the  United  States 

—  2001  U.S.:  anthrax  attacks 

—  1998  Iraq:  “cocktail"  of  weapons  killed  5,000+ 

—  1995  Tokyo:  sarin  nerve  gas,  killed  12,  injured  thou¬ 
sands 


•  Terrorist  groups  are  willing  to  use  asymmetric  measures 

—  Easy  manufacturing,  storing,  and  transportation  ap¬ 
peal  to  terrorists 
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Problem  Dynamics 


•  A  chemical  agent  weapon  is  released  over  a  fixed  opera¬ 
tional  site 

—  Entire  site  enters  the  highest  level  of  MOPP 

—  Contamination  from  secondary  vapors  is  the  main  con¬ 
cern 


•  Reduce  mission  oriented  protective  posture  (MOPP) 

—  MOPP  is  cumbersome 

—  High  levels  of  MOPP  can  reduce  work  efficiency 
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Problem  Dynamics 


Figure  1.  Mission-oriented  protective  postures. 


•  MOPP  0,  MOPP  1,  MOPP  2,  MOPP  3,  MOPP  4,  MOPP  Alpha 

•  Progressively  add  gear  for  increased  safety 


Air  Force  Institute  of  Technology 

Ref:AFVA  32-4012,  http://www.fas.org/nuke/guide/usa/doctrine/usaf/32401200.pdf,  1  March  2005. 
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Problem  Statement 


•  Develop  an  optimal  sampling  strategy 

—  Route  a  search  crew 

*  Reach  as  many  locations  as  possible  (to  identify 
maximum  number  of  areas  below  the  vapor  concen¬ 
tration  threshold) 

*  Time  constraint 

•  Provide  a  framework  for  future  work 

—  Using  sensor  data 

—  Predicting  future  hazard  areas 

Air  Force  Institute  of  Technology  — 
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Model  Assumptions 


•  Rectangular  region  with  a  finite  number  of  “critical”  areas 


•  Single  crew  that  samples  vapor  concentrations 


•  Static,  deterministic,  and  symmetric  travel  times 


•  Travel  at  constant  velocity  with  zero  delays 


•  Fixed  amount  of  time  allotted  for  the  search 
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Model  Assumptions 


•  Chemical  agent/characteristics  are  known 


•  Only  one  instrument  reading  is  required,  consuming  a 
fixed  amount  of  time 


•  Known  fixed  threshold  indicating  contamination/no  con¬ 
tamination 


•  Secondary  vapor  concentrations  evolve  spatially 
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Optimization  Model 


•  Model  the  site  and  its  critical  areas  as  a  network 


•  Develop  a  technique  for  optimally  searching  the  site 


•  Desired  outcome:  Identify  areas  where  secondary  vapor 
levels  have  decreased  (below  the  fixed  vapor  concentra¬ 
tion  level  v*)  so  MOPP  can  be  safely  reduced  at  those 
locations 
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Network  Model 


Consider  the  following  notional  site 


Figure  2.  Graphical  depiction  of  areas  on  an  installation. 
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Network  Model 


Definitions: 

•  G  =  (N,A)  describes  the  graph  with: 

—  A f  =  {1,  2, TV},  where  N  is  the  number  of  critical 
areas 

—  A  =  set  of  arcs  (i,  j)  for  z,  j  e  AT 
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Network  Model 


•  J\fi  =  set  of  nodes  adjacent  to  node  i 

•  ti  j  =  constant  time  required  to  travel  from  node  i  to 
node  j 

-  ti:j  >  0,  V(i,  j)  e  A 

—  tij  =  tjj 


•  Vj(t)  =  nonnegative  vapor  concentration  at  node  j  e  AT 
at  time  t 


•  rj(t)  =  binary  reward  received  from  searching  node  j  at 
time  t 
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Network  Model 


Vj(0  v3(t) 


Figure  3.  Example  of  the  network  representation  for  a  4-node  site. 
.  Af  =  {1,2, 3, 4} 

.  A=  {(1,2),(1,3),(1,4),(2,3),(2,4),(3,4), 

(2, 1),  (3,  1),  (4,  1),  (3,  2),  (4,  2),  (4,  3)} 
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Well-known  Network  Models 


•  Shortest  Path  Problem  (SPP) 

—  Path  from  source  to  sink 

—  Not  all  nodes  must  be  reached 

•  Knapsack  Problem 

—  Maximize  a  value  with  a  constraint  on  the  resource 

—  Order  does  not  matter 
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Well-known  Network  Models 


•  Travelling  Salesperson  Problem  (TSP) 
—  Minimize  tour  length 
—  Must  reach  every  city 
—  Start  and  end  at  the  origin 
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Methodology 


We  consider  four  distinct  cases: 


•  Static  and  deterministic  vapor  concentrations 


•  Static  and  stochastic  vapor  concentrations 


•  Dynamic  and  deterministic  vapor  concentrations 


•  Dynamic  and  stochastic  vapor  concentrations 
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Dynamic  and  Deterministic 


•  Deterministic: 

—  Assume  vapor  level  concentration  at  each  node  can  be 
calculated  deterministically 

•  Dynamic: 

—  Vapor  levels  depend  on  time,  vj(t ),  for  all  j  e  Af,  t  >  0 
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Dynamic  and  Deterministic 


Objective:  Maximize  reward: 

max  ]T  X 

ieJ\f  jeAf 


•  Time  constraint 


•  Backtracking  is  allowed 


•  Vapor  concentrations  are  dynamic  =>*  rewards  are  dynamic 


•  Possibly  not  all  nodes  will  be  reached 
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Algorithm 


Initialization: 

A/"  =  {1,  2, TV};  Ao  =  {j 

^  =  0;  ^  =  0; 
t  <—  to] 

i  =  1; 

Calculate  current  vapor  level  at  node  i,  ^(t) 

If  Vi{t)  <  V* 
ri(t)  <—  1; 

1Z  <—  {i};  ip  <—  pj  U  {i}; 

Else 

n(t)  <—  0; 

^  <—  ^  u  {i}; 

End 
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Algorithm 


Step  1 

Calculate  vj(t  +  t(/)  Vj  e  A/i 

If  Vj(t  tjj)  <  V* 

+  <- 1; 

Else 

+  fjj)  <-  0; 


End 
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Algorithm 


Step  2 

For  each  j  e  Af  such  that  r3  =  1 

Choose  j  such  that  Vj(t  +  Uj)  =  arg  minjGA/-jV  -  Vj(t  +  Uj)} 

7Z^nu{j}] 

^  ^'ipu  { j }; 

End 

If  rj(t  4-  Uj)  =  0  V  j  e  Mi 

Choose  j  such  that  Uj  =  m\r\j{Uj}Wj  c  J\ft 

4  ^  4  u  { j }; 

End 
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Algorithm 


Step  3 

If  t  >  T 

STOP 

Else 

i 

Return  to  Step  1 

End 
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Dynamic/ Deterministic 


Result:  iterative  process  yields  a  time-adaptive  policy 


•  Future  decisions  depend  on  arrival  times  at  nodes 


•  Vapor  concentrations  (rewards)  drive  the  solution 
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Dynamic/Deterministic 


Network  Configuration 
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Dynamic/Deterministic 


Example:  Iteration  1:  to  =  7 
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Dynamic/Deterministic 


Iteration  2: 


v*—  0.0006 
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Dynamic/Deterministic 


Iteration  3: 
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Dynamic/Deterministic 


Final  Solution: 


v*=  0.0006 


t  =  91.77 
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☆ 


Dynamic/Deterministic 


Table  1.  Vapor  concentrations  and  rewards  for  nodes  in 


Node 

t  (min) 

Vj(t) 

r7-(i) 

5 

7.00 

0.000650 

0 

8 

13.16 

0.005400 

0 

10 

18.73 

0.007000 

0 

7 

26.16 

0.005600 

0 

5 

32.92 

0.002800 

0 

8 

39.08 

0.002200 

0 

10 

44.65 

0.001400 

0 

4 

53.78 

0.000410 

1 

7 

60.78 

0.000330 

1 

10 

68.21 

0.000190 

1 

8 

73.78 

0.000110 

1 

9 

81.72 

0.000059 

1 

Air  Force  Institute  of  Technology 
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☆ 


Dynamic/Deterministic 


Table  2.  Vapor  concentrations  and  rewards  at  termination. 


Node 

t)?-(81.72) 

r7(r*) 

1 

0.000023 

1 

2 

0.000025 

1 

3 

0.000030 

1 

4 

0.000034 

1 

5 

0.000040 

1 

6 

0.000042 

1 

7 

0.000052 

1 

8 

0.000054 

1 

9 

0.000059 

1 

10 

0.000057 

1 
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Dynamic  and  Stochastic 


•  Time-variant  probability  distribution  for  each  node  (e.g., 
Vj(t)  ~  exp(^j(t))  for  all  j  e  A f) 


•  Objective:  Maximize  reward  -  The  number  of  areas  searched 
where  the  vapor  concentration  has  most  likely  decreased 
below 

—  Reward  is  dynamic  and  computed  from  the  expected 
value 

—  If  E[Vj(t)]  <  v *,  rj(t)  —  1,  otherwise  rj(t)  =  0. 
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Algorithm 


Initialization: 

A/"  =  {1,  2, TV};  Ao  =  {j 

^  =  0;  ^  =  0; 
t  <—  to] 

i  =  1; 

Obtain  realization  of  vapor  level  ^(t) 

If  <  V* 

n(t)  <—  1; 

1Z  <—  TZ  U  {i};  -0  -0  U  {i}; 

Else 

n(t)  <—  0; 

^  <—  ^  u  {i}; 

End 
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Algorithm 


Step  1 

Calculate  n3(t  +  U:j)  =  P{Vj(t  +  Uj)  <  v*}  Vj  e  M 


Step  2 

Choose  j  such  that  nj(t)  =  maxje^.  P{Vj(t  +  Uj)  <  v*} 
Obtain  instrument  reading  at  this  node. 

If  Vj(t  +  tij)  <  v * 

rj(t)  <-  1;  U  <-  nu{j}\  ^  <-  u  {j}; 

t  <  t  H-  C  j , 

Else 

rj(t)  <—  0; 

^  ^  u  {j}; 

t  <  t  H-  C  ,j  i 

End 
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Algorithm 


Step  3 

If  t  >  T 

STOP 

Else 

i 

Return  to  Step  1 

End 
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Dynamic/Stochastic 


Result:  iterative  process  yields  a  time-adaptive  policy 


•  Future  decisions  depend  on  arrival  times 


•  Probability  a  vapor  concentration  is  below  the  threshold 
v *  drives  the  solution 
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Dynamic/Stochastic 


Example:  Iteration  1: 
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Dynamic/Stochastic 


Iteration  2: 


v*=  0.0006 


P{V2(20.60)<v*}= 
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☆ 


Dynamic/Stochastic 


Table  3:  Vapor  concentrations  for  nodes  in  d  ( v *  =  6.0  x  10-4). 


Node 

t  (min) 

Vj(t) 

rT) 

5 

7 

0.0011 

0 

1 

14.31 

0.000012 

1 

4 

20.83 

0.000106 

1 

10 

29.96 

0.000172 

1 

7 

37.39 

0.000103 

1 

5 

44.15 

0.000113 

1 

1 

51.46 

0.000172 

1 

4 

57.98 

0.000179 

1 

10 

67.11 

0.000609 

1 

7 

74.54 

0.000693 

1 

5 

81.3 

0.000803 

1 

1 

88.61 

0.000001 

1 
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Summary/Conclusions 


•  Ignoring  dynamics  may  lead  to  under-  or  over-estimation 
of  the  number  of  safe  areas  (in  these  examples) 


•  Spatiotemporal  characteristics  are  critical  in  developing 
the  sampling  strategy 


•  Want  to  minimize  Type  II  error  (i.e.,  accept  Hq  that  area 
is  safe  given  it  is  not) 


•  Data  was  assumed  to  exist  for  illustrative  purposes,  how¬ 
ever... 


•  Real  problem  presents  significant  data  requirements 
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Future  Work 


•  Relax  assumptions 

—  Consider  non-deterministic  travel  times 

—  Multiple  search  crews 

—  Estimate  probability  distributions 

•  Incorporate  real-time  information 

—  Real-time  concentration  readings  from  sensors 

—  Road  closures/openings 

—  Weather  changes  (e.g.,  wind  velocity,  temperature, 
humidity,  etc.) 

Air  Force  Institute  of  Technology  — 
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Questions? 
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Backups 


Air  Force  Institute  of  Technology 

UNCLASSIFIED 
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Backup:  A-D  Equation 


The  following  parameters  must  be  known  to  employ  advec- 
tion  diffusion  equation  to  compute  vf 

x,y,z=  coordinates  in  the  direction  of  the  mean  wind,  hor¬ 
izontal  cross-wind,  and  upwards  vertical  direction. 

kx,ky,kz=  eddy  diffusivities  in  m2sec-1 

q  =  the  total  mass  release  in  kg 

h  =  instantaneous  gas  release  height  above  the  ground  in  m 
u  =  wind  velocity  in  m/sec 

Air  Force  Institute  of  Technology  — 
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Backup:  A-D  Equation 


Q 


871-2  (kxkykz)1/2^2 


exp 


0 


exp 


(z  —  h) 
A-kztQ 


( x  —  nto) 


+  exp 


y‘ 


Akyto  _ 

0  +  h )2 

4/c^o 


X 


Ref:  Kathirgamanathan,  P.,  McKibbin,  R.,  and  R.I.  McLachlan  (2003). 
Source  release-rate  estimation  of  atmospheric  pollution  from  a  non¬ 
steady  point  source  -  Part  1:  Source  at  a  known  location.  Res.  Lett. 
Inf.  Math.  Sci.,  5,  71-84. 
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Backup:  A-D  Equation 


Equation  1  can  be  simplified  to 


Vj  ~  3 


Q 


87r2  (kxkykz)1/2^2 


exp 


O  -  uto )2  y‘ 


2  exp 


4-kyto_ 

h ?- 

4-kzto 


x 


since  z  —  0  for  our  numerical  illustrations. 


(2) 
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Backup:  Initial  Rate  Parameters 


Table  6.  Rate  parameters  chosen  for  the  exponential  distributions  used 
for  example  2. 


Node 

lJ,:j 

£[V}](xicr4) 

1 

6666.67 

1.50 

1 

2 

1538.46 

6.50 

0 

3 

1322.75 

7.56 

0 

4 

1574.80 

6.35 

0 

5 

1754.39 

5.70 

1 

6 

10000.00 

1.00 

1 

7 

4347.83 

2.30 

1 

8 

2222.22 

4.50 

1 

9 

909 .09 

11.00 

0 

10 

7692.31 

1.30 

1 
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Case  1:  Static  and  Deterministic 


•  Deterministic: 

—  Assume  vapor  level  concentration  at  each  node  is  cal¬ 
culated  via  a  deterministic  formula  immediately  after 
the  attack 


•  Static: 

—  Assume  for  each  j  e  A f,  Vj  does  not  evolve  over  time 
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Case  1:  Static/Deterministic 


Objective:  Minimize  time  required  to  reach  as  many  areas 
as  possible  to  obtain  the  maximum  reward  (i.e.,  maximum 
number  of  areas  not  requiring  protective  gear). 


•  Time  constraint  implies  it  is  possible  that  not  all  areas 
will  be  sampled 


•  No  backtracking  unless  necessary  (i.e.,  there  is  no  reward 
for  returning  to  an  area) 


•  No  subtours  (<S  c  AT  =  set  of  all  possible  subtours) 
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Case  1:  Static/Deterministic 


Figure  4.  Example  of  subtour  in  a  4-node  site. 
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Case  1:  Static/Deterministic 


max  EEri  Xi,j(opt),  min 

ieAf  jeAf  ieAf  jeAf 

subject  to 


ieAf  jeAf 

< 

T 

Xs j 

jeAf 

1  for  s  <E  AT 

xi,j 

ieAf 

< 

1  for  j  =  1,...,7V;  j  7^  i 

Xi’3 

jeAf 

< 

1  for  i  =  1, N\i  ^  j 

xi,j  %j:i 

< 

1  for  all  (i,  j)  g  .4 

Xij 

ies  jes 

< 

5  -  1  for  <S  G  Af,  2  < 

xi,j 

G 

{0,1} 

N  -  1 
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Case  1:  Static/Deterministic 


Example  1:  Consider  the  following  10-node  network 


r,j  —  1  for  j  —  1,  2,  3, 6,  8, 10;  rj  —  0  for  j  —  4,  5, 7,  9 

Air  Force  Institute  of  Technology 
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Case  1:  Static/Deterministic 


Solution: 


•  Total  time  of  search:  r*  =  62.85  minutes 

•  Optimal  path:  ^=[5,8,10,7,4,1,2,3,6,9] 

Total  reward:  r*  =  6  from  nodes  1,  2,  3,  6,  8,  10 
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Case  2:  Static  and  Stochastic 


•  Stochastic:  Assume  vapor  level  concentration  at  each 
node  is  a  random  variable  Vj,  for  all  j  e  A f,  with  an 
associated  probability  distribution 


•  Static:  P{Vj  <  t*}  does  not  change  with  time,  nor  does 
E[Vj]  Vj  g  AT 
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Case  2:  Static/Stochastic 


Objective:  Minimize  time  required  to  reach  as  many  areas  as 
possible  to  obtain  the  maximum  reward 

•  Same  formulation  as  Case  1 


•  Rewards  are  found  from  expected  vapor  concentrations 
—  E.g.,  Vj  ~  exp(^j)  for  all  j  e  J\f 


—  If  E[Vj]  <  v*,  rj  =  1,  otherwise  rj  =  0. 
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Case  2:  Static/Stochastic 


max  EEri  Xi,j(opt),  min 

ieAf  jeAf  ieAf  jeAf 

subject  to 


ieAf  jeAf 

< 

T 

Xs j 

jeAf 

1  for  s  <E  AT 

,3 

ieAf 

< 

1  for  j  =  j  7^  i 

Y  Xi’3 

jeAf 

< 

1  for  i  =  1, N\i  ^  j 

xi,j  %j,i 

< 

1  for  all  (i,  j)  g  .4 

Y  Y  Xij 

ies  jes 

< 

5  -  1  for  <S  G  Af,  2  < 

xi,j 

G 

{0,1} 

N  -  1 
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Case  2:  Static/Stochastic 


•  Total  time  of  search:  62.85  minutes 

•  Optimal  path:  ^=[5,8,10,7,4,1,2,3,6,9] 

•  Total  reward:  r*  =  6  from  nodes  1,  5,  6,  7,  8,  10 

Air  Force  Institute  of  Technology 
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Comparison:  Deterministic  Results 


Table  4.  Comparison  of  solutions  to  the  static/deterministic  and  dy¬ 
namic/deterministic  examples. 


Static 

Dynamic 

Node 

r3 

Node 

rj(r) 

5 

0 

5 

0 

8 

1 

8 

0 

10 

1 

10 

0 

7 

0 

7 

0 

4 

0 

5 

0 

1 

1 

8 

0 

2 

1 

10 

0 

3 

1 

4 

1 

6 

1 

7 

1 

9 

0 

10 

1 

8 

1 

9 

1 

Total  Time  (min) 

p* 

Total  Time  (min) 

r*(r*) 

62.85 

6 

81.72 

5 
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Comparison:  Deterministic  Results 


•  Static/deterministic  vapor  concentration  case 
—  Search  each  node  exactly  once 
—  Less  amount  of  time 


•  Dynamic/deterministic  vapor  concentration  case 

—  Searches  only  critical  nodes 

—  Utilizes  time  allotted 

—  Total  reward  value  accounts  for  dynamic  nature  of 
concentrations 

Air  Force  Institute  of  Technology  — 
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Comparison:  Deterministic  Results 


Main  result  of  comparisons:  Incorporating  temporal  evolution 
reduces  risk  of  overestimating/underestimating  the  number 
of  areas  safely  operating  without  protective  gear. 

•  Solution  1:  Static 

—  60%  of  the  areas  are  determined  to  be  safe 

—  33%  of  those  will  become  unsafe  at  later  times 

•  Solution  2:  Dynamic 

—  50%  of  areas  are  determined  to  be  safe 

—  3  of  these  were  previously  unsafe 
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Comparison:  Stochastic  Results 


Table  5.  Comparison  of  solutions  to  the  static/stochastic  and  dynamic/stochastic 
examples. 


Static 

Dynamic 

Node 

r3 

Node 

rj(T) 

5 

1 

5 

0 

8 

1 

1 

0 

10 

1 

5 

0 

7 

1 

7 

1 

4 

0 

10 

1 

1 

1 

8 

1 

2 

0 

6 

1 

3 

0 

3 

1 

6 

1 

5 

0 

9 

0 

1 

0 

4 

0 

10 

1 

Total  Time  (min)  r* 

Total  Time  (min) 

r*(r*) 

62.85 

6 

88.61 

5 
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Comparison:  Stochastic  Cases 


•  Static/stochastic  vapor  concentration  case 

—  Search  each  node  exactly  once 

—  Less  amount  of  time 

—  Reward  based  on  expected  vapor  concentrations 

•  Dynamic/stochastic  vapor  concentration  case 

—  Search  is  driven  by  probability  a  node  will  be  less  than 
the  threshold  v* 

—  Rewards  determined  from  expected  values  and  rate 
parameters  are  time-dependent 

Air  Force  Institute  of  Technology  — 
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Comparison:  Stochastic  Cases 


Main  result:  Reduce  risk  of  overestimating/underestimating 
safe  areas  in  dynamic  case.  Stochastic  elements  account  for 
randomness  of  the  real  problem. 


•  Solution  1: 

—  60%  of  areas  are  determined  to  be  safe 

—  Following  this  path  declares  safe  areas  prematurely 

—  2  of  the  areas  would  likely  not  be  safe  at  later  times 
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Comparison:  Stochastic  Cases 


•  Solution  2: 

—  50%  of  areas  are  determined  to  be  safe 

—  1  of  the  unsafe  nodes  in  the  previous  case  becomes 
safe  at  a  later  time 
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